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1 Introduction 



Games such as chess, warfare and politics have been played throughout history. 
Whenever individuals meet who have conflicting desires, and priorities, then 
games are likely to be played. Analysis and understanding of games has existed 
for long times but the emergence of game theory as a formal study of games is 
widely believed to have taken place when Neumann and Morgenstern [T] pub- 
lished their pioneering book "The Theory of Games and Economic Behaviour" 
in 1944. Game theory [2] is now an established discipline of mathematics that 
is a vast subject having a rich history and content. Roughly speaking, game 
theory is the analysis of the actions made by rational players when these actions 
are strategically interdependent. 

The 1970s saw game theory being successfully applied to problems of evo- 
lutionary biology and a new branch of game theory, recognized as evolutionary 
game theory [31 [H [5], came into existence. The concept of utility from eco- 
nomics was given an interpretation in terms of Darwinian fitness . Originally, 
evolutionary game theory considered animal conflicts occurring in macro- world. 
In recent years, research in biology [5] suggested that nature also plays classi- 
cal games at micro-level. Bacterial infections by viruses are classical game-like 
situations where nature prefers dominant strategies . 

In game theory [HE] one finds many examples where multiple Nash equilibria 
(NE) [3 IE] emerge as solutions of a game. To select one (or possibly more) out 
of these requires some refinement of the equilibrium concept [5] ■ A refinement 
is a rule/criterion that describes the criterion to prefer one (in some cases more 
than one) equilibrium out of many. Numerous refinements are found in game 
theory, for example, perfect equilibrium (used for extensive- and normal-form 
games), sequential equilibrium (a fundamental non-cooperative solution con- 
cept for extensive- form games), and correlated equilibrium (used for modelling 
communication among players). 

During recent years quantum game theory [1Q[ 1111 112] has emerged as a new 
research field within quantum information and computation [13] . A significant 
portion of research in quantum games deals with the question asking how quan- 
tization of a game affects/changes the existence/location of a NE. This question 
has been addressed in a number of publications [14] in this area and now it seems 
that it is generally agreed that quantization of a game indeed affects/changes 
the existence/location of a NE. 

In this chapter we argue that, like asking how quantization of a game af- 
fects/changes the existence/location of a NE, an equally important question for 
quantum games is to ask how quantization of a game can affect a refinement of 
the NE concept. We notice that a particular refinement of the NE, known as an 
Evolutionarily Stable Strategy (ESS ), is central to evolutionary game theory 
. While focussing on a this refinement, we motivate those quantum games in 
which a NE persist^ in both of its classical and quantum versions while its 

By saying that a NE persists in both the classical and quantum version of a game we 
mean that there exists a NE consisting of quantum strategies that rewards both the players 
exactly the same the corresponding NE does in the classical version of the game. 
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property of being an ESS survives in either classical or its quantum version, but 
not in the both. We argue that, the quantum games offering such situations, 
along with their quantization procedures, can justifiably be said to extend the 
boundary of investigations in quantum games from existence/location of NE to 
existence/location of one (or more) of its refinements. 

2 Evolutionary game theory and evolutionary 
stability 

The roots of evolutionary game theory [5] can be traced to the puzzle of the 
approximate equality of the sex ratio in mammals. In 1930 Fisher ( [151 116)) 
noticed that if individual fitness is defined in terms of the expected number of 
grandchildren, then it becomes dependent on how males and females are dis- 
tributed in a population. Fisher showed that the evolutionary dynamics then 
leads to the sex ratio becoming fixed at equal numbers of males and females. 
Although Fisher's argument can be recast in game-theoretic language but orig- 
inally it was not presented in those terms. Perhaps it was due to the fact that 
until that time modern game theory had not yet emerged as a formal study of 
games. 

Modern game theory was used, for the first time, to understand evolution 
when in 1972 Maynard Smith and G. R. Price introduced the concept of an 
Evolutionarily Stable Strategy (ESS) [T7l [3] . Presently, this concept is widely 
believed to be the cornerstone of evolutionary game theory [4] and has been 
found quite useful to explain and understand animal behavior. 

Traditionally, game theory had concerned analyzing interactions among hy- 
perrational players and the idea that it can be applied to animals seemed strange 
at the time. The ESS concept made three important changes in the traditional 
meaning of the concepts of a) strategy, b) equilibrium, and c) players' interac- 
tions. 

a) Strategy : In traditional game theory, players have strategy set from 
which they choose their strategies. In biology, animals belonging to a species 
have strategy sets that are genotypic variants that may be mutated, of which in- 
dividuals inherit one or another variant, which they then play in their strategic 
interactions. A mixed strategy in game theory means a convex linear combina- 
tion (with real and normalized coefficients) of pure strategies. Because genotypic 
variants are taken as pure strategies, the evolutionary game theory interprets 
a mixed strategy in terms of proportion of the population that is playing that 
strategy. 

b) Equilibrium : An ESS represents an equilibrium and it is a strategy 
having the property that if a whole population plays it, it cannot be invaded 
under the influence of natural selection , by a small group of players playing 
mutant strategies. Because strategies of evolutionary games are genotypes the 
ESS definition takes the following form: If adapted by a whole population an 
ESS is a genotype that cannot be invaded by another genotype when it appears 
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in a small fraction of the total population. 

c) Player interactions : The ESS concept is about repeated and random 
pairing of players who play strategies based on their genome and not on the 
previous history of play. This approach was new to the usual approach of one- 
shot and repeated games of classical game theory . 

Consider a large population [51 [5] in which members are matched repeatedly 
and randomly in pairs to play a bi-matrix game . The players are anonymous, 
that is, any pair of players plays the same symmetric bi-matrix game . The 
symmetry of a bi-matrix game means that for a strategy set S Alice's payoff 
when she plays Si e S and Bob plays S% € S is the same as Bob's payoff when 
he plays Si and Alice plays Sq. Hence, a player's payoff is defined by his/her 
strategy and not by his/her identity and an exchange of strategies by the two 
players also exchanges their respective payoffs. A symmetric bi-matrix game is 
represented by an expression G = (M, M T ) where M is the first player's payoff 
matrix and M T , being its transpose, is the second players' payoff matrix . In 
a symmetric pair-wise contest one can write P(x, y) as being the payoff to a 
i-player against a y-player. 

To be precise [U [18j US] a strategy x is said to be an ESS if: 

a) for each mutant strategy y there exists a positive invasion barrier . 

b) if the population share of individuals playing the mutant strategy y falls 
below the invasion barrier, then x earns a higher expected payoff than y. 

Mathematically speaking [51 0] a; is an ESS when for each strategy y ^ x the 
inequality 



holds for all sufficiently small e > 0. In ([TJ the expression on the left-hand side 
is payoff to the strategy x when played against the mixed strategy (1 — e)x + 
ey. This condition for an ESS is shown [T71 [3j [5J equivalent to the following 
requirements: 



It turns out (3] [5J that an ESS is a symmetric NE that is stable against small 
mutations. Condition a) in the definition @ shows (x,x) is a NE for the bi- 
matrix game G = (M, M T ) if x is an ESS . However, the converse is not true. 
That is, if (x, x) is a NE then x is an ESS only if x satisfies condition b) in 
definition ©. 

Evolutionary game theory defines the concept of fitness [20] of a strategy as 
follows. Suppose x and y are pure strategies played by a population of players 
that is engaged in a two-player game. Their fitnesses are 



W{x) = P(x,x)F x +P(x,y)F y ; W(y) = P(y, x)F x + P(y,y)F y (3) 



P[x, (1 - e)x + ey] > P[y, (1 - e)x + ey] 



(1) 



a) P(x.x) > P(y,x) 
b) If P{x, x) = P(y, x) then P(x, y) > P(y, y). 



(2) 
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where F x and F y are frequencies (the relative proportions) of the pure strategies 
x and y respectively. 

It turned out that an ESS is a refinement on the set of symmetric Nash 
equilibria 5, 21 . For symmetric bi-matrix games this relationship is described 
|23] as A ESS c A PE c A NE where A PE ^ $ and A NE , A PE , A ESS are the 
sets of symmetric NE, symmetric proper equilibrium, and ESSs respectively. 

The property of an ESS of being robust against small mutations is also re- 
ferred to as evolutionary stability [T5], [H5] . This concept provided a significant 
part of the motivation for later developments in evolutionary game theory . In 
evolutionary game theory, the Darwinian natural selection is formulated as an 
algorithm called replicator dynamics [H [5] which is a mathematical statement 
saying that in a population the proportion of players playing better strategies 
increases with time. Mathematically, ESSs come out as the rest points of repli- 
cator dynamics [U [5] . 

Evolutionary stability was found to be a useful concept because it says some- 
thing about the dynamic properties of a system without being committed to a 
particular dynamic model. Sometimes, it is also described as a model of ratio- 
nality which is physically grounded in natural selection . 

2.1 Population setting of evolutionary game theory 

Evolutionary game theory introduces so-called the population setting [5113] that 
is also known as population- statistical setting . This setting assumes a) an in- 
finite population of players who are engaged in random pair-wise contests b) 
each player being programmed to play only one strategy and c) an evolutionary 
pressure ensuring that better-performing strategies have better chances of sur- 
vival at the expense of other competing strategies. Because of b) one can refer 
to better-performing players as better-performing strategies. 

The population setting of evolutionary game theory is not alien to the con- 
cept of the NE, although it may give such an impression. In fact, John Nash 
himself had this setting in his mind when he introduced this concept in game 
theory. In his unpublished Ph.D. thesis [231 [4] he wrote l it is unnecessary to as- 
sume that the participants have... the ability to go through any complex reasoning 
process. But the participants are supposed to accumulate empirical information 
on the various pure strategies at their disposal... We assume that there is a pop- 
ulation. ..of participants. ..and that there is a stable average frequency with which 
a pure strategy is employed by the "average member" of the appropriate popula- 
tion' '. 

That is, Nash had suggested a population interpretation of the NE concept 
in which players are randomly drawn from large populations. Nash assumed 
that these players were not aware of the total structure of the game and did 
not have either the ability nor inclination to go through any complex reasoning 
process. 
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3 Quantum games 



This chapter considers evolutionary stability in quantum games that are played 
in the two quantization schemes: Eisert, Wilkens, Lewenstein (EWL) scheme 
[TT1U3 for playing quantum Prisoners' Dilemma (PD) and Marinatto and Weber 
(MW) scheme [5J for playing quantum Battle of Sexes (BoS) game. 

EWL quantization scheme appeared soon after Meyer's publication [115] of 
the PQ penny-flip - a quantum game that generated significant interest and is 
widely believed to have led to the creation of the new research field of quantum 
games . MW scheme derives from EWL scheme but it gives a different meaning 
to the term 'strategy' [251 125] . 

EWL quantum PD assigns two basis vectors |C) and |D) in the Hilbert 
space of a qubit . States of the two qubits belong to two-dimensional Hilbert 
spaces Ha and Hb, respectively. The state of the game is defied as being a 
vector residing in the tensor- product space Ha <8 Hb, spanned by the basis 
|CC) , |CD) , | DC) and |DD). Game's initial state is |^> ini ) = J |CC) where J 
is a unitary operator known to both the players. Alice's and Bob's strategies 
are unitary operations U a and Ub, respectively, chosen from a strategic space §. 
After players' actions the state of the game changes to Ua ® UbJ |CC) . Finally, 
the state is measured and it consists of applying reverse unitary operator 
followed by a pair of Stern-Gerlach type detectors . Before detection the final 
state of the game is \i/)fi n ) — J'Ua <8 UbJ |CC). Players' expected payoffs are 
the projections of the state iV'/in) onto the basis vectors of tensor-product space 
Ha®Hb, weighed by the constants appearing in the following game matrix 



where C and D are the classical strategies of Cooperation and Defection, re- 
spectively. The first and the second entry in small braces correspond to Alice's 
and Bob's (classical, pure strategy) payoffs, respectively. When s < u < r < t 
the matrix (TJJ represents PD. In EWL quantum PD Alice's payoff, for example, 
reads 



P A =r\(CC\ iP fin ) | 2 + a | (CD | ^ /in )| 2 + 1 1 (DC | ^ fin ) | 2 + u | (DD | ^ fm )\ 2 . 

(5) 



With reference to the matrix (rjj Bob's payoff is, then, obtained by the trans- 
formation s t in Eq. ([5J. Eisert and Wilkens [T2] used following matrix 
representations of unitary operators of their one- and two-parameter strate- 
gies, respectively: 



Bob 
C D 




G 



where 



_ , cos(0/2) sin(0/2) \ f . 

{ > I -sin(0/2) cos(0/2) J [ ' 

, e*coB(0/2) sin(0/2) \ 

L'W^-l . sin ( / 2 ) e-^cos(0/2) ) (n 



O<6»<7randO<0< tt/2. (8) 



To ensure that the classical game is faithfully represented in its quantum version, 
EWL imposed an additional conditions on J: 



J,D®D 



0. 



J,D®C 



0. 



J,C®D 



(9) 



with C and D being the operators corresponding to the classical strategies C 
and D, respectively. A unitary operator satisfying the condition |9]) is 

J = cxp jfyD (g) -D/2 j (10) 

where 7 € [0, 7r/2] and J represents a measure of the game's entanglement . At 
7 = the game can be interpreted as a mixed-strategy classical game. For a 
maximally entangled game 7 = tt/2 the classical NE of D (g> D is replaced by 
a different unique equilibrium Q ®Q where Q ~ ?7(0,7r/2). This new equilib- 
rium is found also to be Pareto optimal |2J, that is, a player cannot increase 
his/her payoff by deviating from this pair of strategies without reducing the 
other player's payoff. Classically (C, C) is Pareto optimal, but is not an equilib- 
rium [2], thus resulting in the 'dilemma' in the game. It is argued [23, EH] that 
in its quantum version the dilemma disappears from the game and quantum 
strategies give a superior performance if entanglement is present. 

MW quantization scheme [24l [25l [26] for BoS identifies a state in 2 ® 2 
dimensional Hilbert space as a strategy. At the start of the game the players 
are supplied with this strategy and the players manipulate the strategy in the 
next phase by playing their tactics. The state is finally measured and payoffs 
are rewarded depending on the results of the measurement. A player can do 
actions within a two-dimensional subspace. Tactics are therefore local actions 
on a player's qubit. The final measurement, made independently on each qubit , 
takes into consideration the local nature of players' manipulations. This is done 
by selecting a measurement basis that respects the division of Hilbert space into 
two equal parts. 

Essentially MW scheme differs from EWL scheme [TT] [12] in the absence of 
reverse gatel jt. Finally, the quantum state is measured and it is found that 
the classical game remains a subset of the quantum game if the players' tactics 



2 EWL introduced the gate J< before measurement takes place that makes sure that the 
classical game remains a subset of its quantum version. 
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Set of unitary operators 




Figure 1: EWL scheme to play a quantum game. 



are limited to a convex linear combination, with real coefficients, of applying 
the identity I and the Pauli spin- flip operator a x . Classical game results when 
the players are forwarded an initial strategy \ip% n ) = |00). 

Let pi n be the initial strategy the players Alice and Bob receive at the start of 
the game. Assume Alice acts with identity I on p in with probability p and with 
a x with probability (f — p). Similarly, Bob act with identity / with probability 
q and with a x with probability (1 — q). After players' actions the state changes 
to 

Pfvn = Pqh ® IbPitiIa ®I b + p(l - q)lA ® VxBPini\ ® °Ib + 

q(l - p)a xA ® lBP m ol A ® P B + 

(1 - p)(l - q)G xA ® & xB PinO-t A ® <^b- ( n ) 
When the game is given by the bi-matrix: 

Bob 

Alice J ( f A > aB l ^1 B \ ) (12) 
the payoff operators are: 



{P A )o P er = a A |00) (00| + p A |01) (Of | + 1A 1 10) (10| + <5a |H) (H| 
(P B )o P er = a B |00) (00| + f3 B |01) (01| + 7B |10) (10| + S B |11) (11| . (13) 



8 



Hermitian and unitary 
operators 




Figure 2: MW scheme to play a quantum game. 



and payoff functions are then obtained as mean values of these operators: 

P A . B = Tr {{P A }■ (14) 

It is to be pointed out that in EWL set-up a quantum game corresponds 
when the entanglement parameter 7 of the initial quantum state is different 
from zero. When 7 is non-zero the players have strategies available to them 
that result in the classical game. The general idea is to allow a range of values 
to the parameter 7 and then to find how it leads to a different, i.e. non-classical, 
equilibrium in the game. 

In MW scheme [MJ [25j [26] an initial strate gy is forwarded to two players 
who then apply their tactics on it and the classical game corresponds to the 
initial state 1 00) . Assume now that the players receive pure two-qubit states, 
different from |00), and the measurement remains the same. A quantum form 
of the game then corresponds if initial states different from the product state 
1 00) are used. This translates finding quantum form of a matrix game to finding 
appropriate initial state(s). This is justified because the only restriction [26] on 
a quantum form of a game being that the corresponding classical game must be 
reproducible as its special case. As the product initial state 1 00} always results 
in the classical game, this approach remains within the mentioned restriction. 

In EWL scheme one looks for new equilibria in games in relation to the 
parameter 7. In the above approach, however, one finds equilibria in relation to 
different initial states. In this chapter, we will restrict ourselves to pure states 
only. 
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4 Evolutionary stability in quantum games 



The concept of a NE was addressed in the earliest research publications in quan- 
tum games |1HI12) . Analysis of this solution concept from non-cooperative game 
theory generated significant interest in the new research held. These publica- 
tions do not explicitly refer to the population interpretation of the NE concept. 
In fact, this possibility of this interpretation was behind the development of 
the ESS concept in evolutionary game theory. And when this interpretation is 
brought within the domain of quantum games it becomes natural to consider 
ESSs in this domain. 

One may ask how and where the population setting may be relevant to quan- 
tum games . How can a setting, originally developed to model the population 
biology problems, be relevant and useful to quantum games ? One can often 
sharpen this argument given the fact that, to date, almost all of the experimen- 
tal realizations of quantum games are artificially constructed in laboratories 
using quantum computational circuits [13] . 

Several replies can be made to this question, for example, that this setting 
was behind the development of the NE concept that was addressed in the earliest 
constructions of quantum games attracting significant attention. One also finds 
that evolutionary stability has very rich literature in game theory, mathematical 
biology and in evolutionary economics [29, 30J. In quantum games the NE has 
been discussed in relation to quantum entanglement [13] and the possibility that 
the same can be done with evolutionary stability clearly opens a new interesting 
role for this quantum phenomenon. It is conjectured that the possibility of this 
extended role for entanglement may perhaps be helpful to better understand 
entanglement itself. 

Evolutionary stability presents a game-theoretic model to understand evolu- 
tionary dynamics. Recent developments in quantum games motivate to ask how 
this game-theoretic solution concept adapts/shapes/changes itself when players 
are given access to quantum strategies . This questions is clearly related to a 
bigger question: Can quantum mechanics have a role in directing, or possibly 
dictating, the dynamics of evolution? We believe that for an analysis along 
this direction the evolutionary stability offers an interesting situation because, 
firstly, it is a simple and a beautiful concept and, secondly, it is supported by 
extensive literature [18l [4] . 

To discuss evolutionary stability in quantum games may appear as if a con- 
cept originally developed for population biology problems is arbitrarily being 
placed within the domain of quantum games. One can reply to this by noticing 
that population biology is not the only relevant domain for the concept of evolu- 
tionary stability . This concept can also be interpreted using infinitely repeated 
two-player games and without referring to a population of players. Secondly, as 
the Nash's thesis [23l H] showed it, it is not the population biology alone that 
motivates a population setting for game theory - responsible for the concept 
of evolutionary stability . Surprisingly, the concept of NE also does the same, 
although it may not be recognized generally. 

The usual approach in game theory consists of analyzing games among 
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hyper-rational players who are always found both ready and engaged in their 
selfish interests to optimize their payoffs or utilities. Evolutionary stability has 
roots in the efforts to get rid of this usual approach that game theory had fol- 
lowed. The lesson it teaches is that playing games can be disassociated from 
players' capacity to make rational decisions. This disassociation seems equally 
valid in those possible situations where nature plays quantum games d. It is be- 
cause associating rationality to quantum-interacting entities is of even a more 
remote possibility than it is the case when this association is made to bacteria 
and viruses, whose behavior evolutionary game theory explains. 

In the following we will try to address the following questions: How ESSs 
are affected when a classical game, played by a population, changes itself to a 
quantum form? How pure and mixed ESSs are distinguished from one another 
when such a change in the form of a game takes place? Can quantum games 
provide a route that can relate evolutionary dynamics, for example, to quantum 
entanglement ? Considering a population of players in which a classical strategy 
has established itself as an ESS , we would like to ask: a) What happens when 
'mutants' of ESS theory come up with quantum strategies and try to invade 
the classical ESS? b) What happens if such an invasion is successful and a new 
ESS is established - an ESS that is quantum in nature? c) Suppose afterwards 
another small group of mutants appears which is equipped with some other 
quantum strategy . Will it successfully invade the quantum ESS? 

4.1 Evolutionary stability in EWL scheme 

EWL used the matrix (T5|) with r = 3, s = 0, t = 5, and u = 1 in their proposal 
for quantum PD. Assume a population setting where in each pair- wise encounter 
the players play PD with the same matrix and each contest is symmetric. Which 
strategies will then be likely to be stable? Straightforward analysis [20] shows 
that D will be the pure classical strategy prevalent in the population and hence 
the classical ESS. We consider following three cases: 

Case (a) A small group of mutants appear equipped with one-parameter 
quantum strategy U (8) when D exists as a classical ESS 

Case (b) Mutants are equipped with two-parameter quantum strategy U (9, <p) 
against the classical ESS 

Case (c) Mutants have successfully invaded and a two-parameter quantum 
strategy Q ~ U(0, tt/2) has established itself as a new quantum ESS. Again an- 
other small group of mutants appear, using some other two-parameter quantum 
strategy, and tries to invade the quantum ESS, which is Q. 

Case (a): Because players are anonymous one can represent P(U(9), D) as the 
payoff to t/(c?)-player against the D-player. Here U(9) is the Eisert and Wilkens' 
one-parameter quantum strategy set ©. Players' payoffs read P(U(9),D) = 
sin 2 ((9/2); P(U(6),U(6)) = 2cos 2 ((9/2) + 5cos 2 (6l/2) sin 2 (6»/2) + l; P(D,U(6)) = 

3 Although, no evidence showing nature playing quantum games has been found to date, 
the idea itself does not seem far-fetched. 
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5cos 2 (<9/2) +sin 2 (6>/2); and P{D,D) = 1. Now P(D, D) > P(U(9),D) for all 
9 £ [0, 7r). Hence the first condition for an ESS holds and D ~ U(tt) is an ESS. 
The case 9 = 7r corresponds to one-parameter mutant strategy coinciding with 
the ESS, which is ruled out. If D ~ U(tt) is played by almost all the members 
of the population - which corresponds to high frequency Fd for D — we then 
have W(D) > W{9) for all 9 £ [0 tt) using the definition ©. The fitness of 
a one-parameter quantum strategjQ therefore, cannot exceed the fitness of a 
classical ESS. And a one-parameter quantum strategy cannot invade a classical 
ESS. 

Case (b): Let U(9,(f>) be a two-parameter strategy from the set ([7]). The 
expected payoffs read P(D,D) = 1; P(D,U(0,<j>)) = 5 cos 2 (» cos 2 (6»/2) + 
sin 2 (6»/2); P(U(9, tf>),D) = 5sin 2 (» cos 2 (6>/2) + sin 2 (6>/2); and 

P(U(9, </>), U(9, <t>)) = 3 |cos(20) cos 2 (0/2)| 2 

+ 5cos 2 (<9/2) sin 2 ((9/2) |sin(0) - cos{<j))\ 2 

+ |sin(20)cos 2 (6'/2) + sin 2 (e'/2)| 2 . (15) 

HereP(L>,L») > P(U(0, <f>),D) if <p < arcsin(l/\/5) andifP(L>,D) = P(U(9, <f>),D) 
then P(D,U(0,4>)) > P(fr(9,<f)),U(0 x <j>)). Therefore, D is an ESS if < 
arcsin(l/v5) otherwise the strategy U(0,<p) W1 U be in position to invade D. 
Alternatively, if most of the members of the population play D ~ U(tt,0) - 
which means a high frequency Fd for D - then the fitness W(D) will remain 
greater than the fitness W[U(0, 4>)] if <j) < arcsin(l/v5)- For > arcsm(l/- v / 5) 
the strategy C/(#, 0) can invade the strategy D, which is the classical ESS. 

In this analysis mutants are able to invade D when <f> > arcsin(l/v / 5) and 
the invasion may seem not so unusual given the fact that they exploit richer 
strategies. But it leads to the third case i.e. when 'quantum mutants ' have 
successfully invaded and a two-parameter strategy U has established itself. Can 
now some new mutants coming up with Q ~ U(0, 7r/2) and invade the 'quantum 
ESS'? 

Case (c): EWL [TTJ [T2] showed that in their quantum PD the quantum strat- 
egy Qj played by both the players, is the unique NE. How mutants playing Q 
come up against U(0, 4>) which already exists as an ESS? To find it the following 
payoffs are obtained. P{Q,Q) = 3; P(U(6,<f>),Q) = [3 - 2cos 2 (< ? !))] cos 2 (<9/2); 
and P(Q, U(0, <j>)) = [3 - 2cos 2 (»] cos 2 (6>/2) + 5sin 2 (6»/2). Now the inequality 
P(Q,Q) > P{U{0,<f>),Q) holds for all 9 £ [0, tt] and <j) £ [0,tt/2] except when 
9 = and = tt/2, which is the case when the mutant strategy U(0, <f>) is the 
same as Q. This case is obviously ruled out. The first condition for Q to be 
an ESS, therefore, holds. The condition P(Q, Q) = P{U(0, (/>), Q) implies = 

4 In EWL set-up one-parameter quantum strategies correspond to mixed (randomized) 
classical strategies. 
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and <f> = 7r/2. Again we have the situation of mutant strategy same as Q and 
the case is neglected. If Q is played by most of the players, meaning high fre- 
quency Fq for Q, then W(Q) > W[U(8, <£)] for all 6 G (0, tt] and G [0, tt/2). A 

two-parameter quantum strategy U{6, <p), therefore, cannot invade the quantum 
ESS (i.e. the strategy Q ~ tl(0, 7r/2)). Mutants' access to richer strategies, as 
it happens in the case (B), does not continue to be an advantage as most of the 
population also have access to it. Hence Q comes out as the unique NE and 
ESS of the game. 



4.1.1 Evolutionary stability and entanglement 

Above analysis motivates to obtain a direct relationship between a measure of 
entanglement and the mathematical concept of evolutionary stability for two- 
player games. The following example shows this relationship. Consider the 
two-player game given by the matrix (fT6|) : 

Bob 
Si 5*2 

Alice * ( <£ r \ ) (16) 

S" 2 V (i,s) (u,u) J 

and suppose Alice and Bob play the strategy Si with probabilities p and q, 
respectively. The strategy S2 is then played with probabilities (1 — p) and 
(1 — q) by Alice and Bob, respectively. We denote Alice's payoff by Pa{p, q) 
when she plays p and Bob plays q. That is, Alice's and Bob's strategies are now 
identified by the numbers p,q G [0, 1], without referring to Si and S2. For the 
matrix (TT^|) Alice's payoff Pa(p, q), for example, reads 

P A {p,q) = rpq + sp(l - q) + t{l - p)q + u(l - p)(l - q). (17) 

Similarly, Bob's payoff Pb{Pi1) can be written. In this symmetric game we 
have Pa(PtQ) = Pb(QtP) and, without using subscripts, P(p,q), for example, 
describes the payoff to p-player against g-player. In this game the inequality 

p(p*,p*)-p(p,p*) ^0 (18) 

says that the strategy p*, played by both the players, is a NE. We consider the 
case when 

s = t, r = u and (r - t) > (19) 

in the matrix (fT6)) . In this case the inequality (jT8|) along with the definition 
(fT?) gives 

P(p*,P*) ~ P(p,p*) = (p* - p)(r - t)(2p* - 1) (20) 

and the strategy p* — 1/2 comes out as a mixed NE. From the ESS definition 
(HI we get P(l/2, 1/2) - P(p, 1/2) = and the part a) of the definition does not 
apply. Part b) of the definition ([2]), then, gives 
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P(l/2,p) - P(p,p) = (r - t) {2p(l -p) - 1/2} (21) 



which can not be strictly greater than zero given (r— t) > 0. For example, at p = 
it becomes a negative quantity. Therefore, for the matrix game defined by (|16[) 
and (TT5]) the strategy p* = 1/2 is a symmetric NE, but it is not evolutionarily 
stable. Also, at this equilibrium both players get (r + 1)/2 as their payoffs. 

Now consider the same game, defined by (fT6)l and (fl"9|) . when it is played 
by the set-up proposed by EWL. We set sa = {9a, 4*a) an d s B = (9 b ,4>b) to 
denote Alice's and Bob's strategies, respectively. Because the quantum game is 
symmetric i.e. Pa(sa, sb) = Pb(sb, sa) we can write, as before, P(sa, sb) for 
the payoff to s^-player against s^-player. For the quantum form of the game 
defined by (| 161 1 9[) one finds 

P(sa 7 sb) = (1/2) (r— t) {1 + cos6U cos 6>_b + sixiBa sin 9b sin7sin(<^4 + </>#)}+£. 

(22) 

The definition of a NE gives P(s*,s*) — P(s,s*) ^ where s = {9,<j>) and 
s* = (9* ,(f>*). This definition can be written as 

{d e P \ e .,p (9* -9)+ d^P | fl .,^. (0* - </>)} > 0. (23) 

We search for a quantum strategy s* = (9* , <j?) for which both dgP and 
d(f>P vanish at 7 — and which, at some other value of 7, is not zero. For 

the payoffs (|2"2"|) the strategy s* = (tt/2,tt/A) satisfies these conditions. For this 
strategy Eq. (|22|) gives 

P(s*,s*) - P(s,s*) = (l/2)(r-*)sin7{l-sin(<£ + 7r/4)sm0}. (24) 

At 7 = the strategy s* — (tt/2, 7t/4), when played by both the players, is a NE 
and it rewards the players same as does the strategy p* = 1/2 in the classical 
version of the game i.e. (r + t)/2. Also, then we have P(s* , s*) — P(s, s*) = 
from Eq. and the ESS's second condition in @ applies. Use Eq. (|2"2"j) to 
evaluate 

P{s*,s) - P{s,s) = -{r -t)cos 2 {9)+ 

(l/2)(r-<)sin7sin6»{sin((?!) + 7r/4) - sin 9 sin(20)} (25) 

which at 7 = reduces to P(s* , s) — P(s, s) = — (r — t) cos 2 (6>), that can assume 
negative values. The game's definition p^|) and the ESS's second condition in 

show that the strategy s* = (ir/2, 7r/4) is not evolutionarily stable at 7 = 0. 

Now consider the case when 7 ^ in order to know about the evolutionary 
stability of the same quantum strategy. From ([5]) we have both sin#, sin(</> + 
7r/4) G [0,1] and Eq. ([24]) indicates that s* = (tt/2,tt/4) remains a NE for 
all 7 £ [0,7r/2]. The product sm((j> + 7r/4)sin0 attains a value of 1 only at 
s* = (7r/2,7r/4) and remains less than 1 otherwise. Eq. (|24p shows that for 
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7^0 the strategy s* = (tt/2, it/4) becomes a strict NE for which the ESS's 
first condition in ([2]) applies. Therefore, for the game defined in (fT9|) the strategy 
s* = (tt/2, 7r/4) is evolutionarily stable for a non-zero measure of entanglement 
7. That is, entanglement gives evolutionary stability to a symmetric NE by 
making it a strict NE, that is, it is achieved by using in @ the ESS's first 
condition only. Perhaps, a more interesting example would be the case when 
entanglement gives evolutionary stability via the ESS's second condition. In 
that case, entanglement will make P(s*,s) strictly greater than P(s,s) when 
P(s*,s*) and P(s, s*) are equal. 

It is to be pointed out here that in literature there exists an approach [31) 
which characterizes ESSs in terms of extremal states of a function known as 
evolutionary entropy that is defined by 



where \ii represents the relative contribution of the «-th strategy to the total 
payoff. A possible extension of the present approach may be the case when 
quantum entanglement decides extremal states of evolutionary entropy. Ex- 
tension along similar lines can be proposed for another quantity called relative 
negentropy |18j that is optimized during the course of evolution. 

4.2 Evolutionary stability in MW quantization scheme 

Another interesting route that allows to consider evolutionary stability in re- 
lation to quantization of a game is provided by MW scheme [23] ■ In this 
scheme a transition between classical and quantum game is achieved by the 
initial state: classical payoffs are obtained when the initial state is a product 
state \ipin) = 1 00) . In this scheme one can consider evolutionary stability in a 
quantum game by asking whether it possible that a particular symmetric NE 
switches-over between being an ESS and not being an ESS when the initial state 
(initial strategy) changes from being \if>i n ) = 1 00) to another state. MW scheme 
offers the possibility to make transition from classical to quantum version of 
a game by using different initial states and it appears to be a more suitable 
quantization scheme to analyze evolutionary stability in quantum games. It is 
because: 

a) In a symmetric bi-matrix game , played in a population setting, players 
have access to two pure strategies and a mixed strategy is interpreted as a convex 
linear combination of pure strategies. Similar is the case with the players' 
strategies in MW scheme where a mixed strategy consists of a convex linear 
combination of the players' actions with two unitary operators . 

b) Fitness of a pure strategy can be given a straightforward extension in 
MW scheme . It corresponds to a situation when, for example, in the quantum 
game, a player uses only one unitary operator out of the two. 

c) Theory of ESSs, in the classical domain, deals with anonymous players 
possessing discrete number of pure strategies. EWL scheme involves a contin- 




(26) 
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uum of pure quantum strategies . The ESS concept is known to encounter 
problems [32 when players possess a continuum of pure strategies. 



4.2.1 2x2 asymmetric games 

An ESS is defined as a strict NE [5] for an asymmetric bi-matrix game, i.e. the 
game G = (M, N) for which N ^ M T . That is, a strategy pair (x, y) £ S is an 
ESS of the game G if Pa(x,ij) > Pa{x,u) and Pe(x,y) > Pg(x, y) for all x ^ x 
and y ^ y. For example, the BoS: 



(a,/3) (7,7) 
(7,7) (A a) 



(27) 



where a > (3 > 7 is a asymmetric game with three classical NE given as 1) 
p x = I = 2) p 2 = q 2 = 1 and 3) p 3 = * = Here the NE 1) 

and 2) are also ESS's but 3) is not because of not being a strict NE. When the 
asymmetric game (|27p is played with the initial state \tpi n ) = a \ SiSi) + b \S2S2), 
where Si and S 2 are players' pure classical strategies, the following three NE 

[24] emerge 1) p l = q x = 1 2) p 2 = q 2 = and 3) p 3 = a+f3 l 2l ■ & = 

(a-7)|b|^+( / 3-7)|a| ^ turns out that, similar to the classical case, the quantum 
NE 1) and 2) are ESSs while 3) is not. Now, play thsi game with a different 
initial state: 

\^n)=a\S 1 S 2 )+b\S 2 S 1 ) (28) 
for which players' payoffs are: 



P A (p, q) = p{-q(a + (3 - 2 7 ) + a \af + (3 \b\ 2 - 7} + 

<z{a|&| 2 +/?H 2 -7}+7 
Pb(p, q) = q {~p(a + (3 - 2 7 ) + f3 \a\ 2 + a \b\ 2 - 7} + 

p{/3| | 2 +a|a| 2 - 7 }+7 (29) 

and there is only one NE i.e. p = z 3 !"! ~7 A* = °M -1 which is not 

an ESS. So that, no ESS exists when BoS is played with the state (1281) . 
Consider now another game: 



(ax,a 2 ) (^1,^2) 
(71,72) (0-1,0-2) 



(30) 



for which 



7i 01 / V 72 o 2 



T 



ax Pi \ ( a 2 ft j (31) 
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and that it is played by using initial state \tpi n ) — a\SiSi) + b\S2S2) with 
\a\ 2 + \b\ 2 = 1. Players' payoffs are: 

P A , B (p, (?) = ai l2 {pq \a\ 2 + (1 -p)(l - ?) |6| 2 } 

+ ft, 2 {p(i-<z)H 2 + <z(i-p)H 2 } 

+ 7i,2 {p(l-g)|6| 2 +g(l-p)|a| 2 } 

+ a 1 , 2 { M |&| 2 + (l-p)(l- (Z )| a | 2 }. (32) 

The NE conditions are 



Pa{p,q) ~ PA{p,q) = 
(p - p) [\a\ 2 (ft - + |6| 2 ( 71 - ai ) - £{(ft - a,) + (71 - «i)}] > (33) 

P B (p,q)-P B $,q) = 
(q-q) [|a| 2 (72-T 2 ) + |6| 2 (/3 2 -a 2 )-p{( 72 -a 2 ) + (/3 2 -a 2 )}] > 0. (34) 

So that, for p = q = to be a NE we have 



P A (0,0) - P A (p, 0) = -p (ft - ax) + \b\ 2 {(71 - ai) - (ft - ai )} 



Ps(0,0)-P B (0,g) 



(72 - o- 2 ) + |6| 2 {(/3 2 - a 2 ) - (72 - cr 2 )} 



> 

> 



(35) 



and for the strategy pair (0, 0) to be an ESS in the classical game@ we require 
P A (0,0)-P A (p,0) = -p(ft-<n) > 0andP B (0,0)-P s (0, g ) = -5(72-^2) > 
for all p, q 7^ 0. That is, (ft — < and (72 — er 2 ) < 0. For the pair (0, 0) not 
to be an ESS for some |6| 2 ^ 0, let take 71 = a\ and ft = a 2 and we have 



P A (0,0) - P A (p,0) = -p(ft - ax) {l - |6| 2 } 
P B (0,0) - P s (0, <?) = -g( 72 - a 2 ) {l - \b\ 2 } 



(36) 



i.e. the pair (0, 0) doesn't remain an ESS at \by = 1. A game having this 
property is given by the matrix: 



(1,1) (1,2) 
(2,1) (3,2) 



(37) 



5 which corresponds when \b\ 2 =0 
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For this game the strategy pair (0,0) is an ESS when \b\ 2 = (classical game) 
but it is not when for example \b\ 2 — |> though it remains a NE in both the 
cases. The example shows a NE switches between ESS and 'not ESS' by using 
different initial state. In contrast to the last case, one can also find initial states 
- different from the one corresponding to the classical game - that turn a NE 
strategy pair into an ESS. An example of a game for which it happens is 

Bob 

- * ( ai h )■ 

Playing this game again via the state |^ n ) = a | Si Si) + fe^S^) gives the 
following payoff differences for the strategy pair (0, 0): 

P A (0,0) - P A (p,0) =p\b\ 2 and P B (0, 0) - P B {0, q) = q \b\ 2 (39) 

for Alice and Bob respectively. Therefore, (|3"8")) is an example of a game for 
which the pair (0, 0) is not an ESS when the initial state corresponds to the 
classical game. But the same pair is an ESS for other initial states for which 
0<H 2 <1. 

4.2.2 2x2 symmetric games 

Consider now a symmetric bi-matrix game: 

Bob 

**• I ( ti h ) 

that is played by an initial state: 

= a ISxSx) + b \S 2 S 2 ) , with H 2 + \b\ 2 = 1. (41) 

Let Alice's strategy consists of applying the identity operator / with probability 
p and the operator a x with probability (1 — p), on the initial state written pi n 
in density matrix notation. Similarly Bob applies the operators / and a x with 
the probabilities q and (1 — q) respectively. The final state is 

Pfin= p *(U A )Pr(U B )[U A ®U BPin u\®U B ] (42) 

0=t,& x 

where unitary and Hermitian operator U is either I or a x . Pt(U~a), Pr(U B ) are 
the probabilities, for Alice and Bob, respectively, to apply the operator on the 
initial state. The matrix pfi n is obtained from pi n by making a convex linear 
combination of players' possible quantum operations. Payoff operators for Alice 
and Bob are EH 
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(Pa \S 1 S 1 )(S 1 S 1 \+P, 7 \S 1 S 2 ) (5i5 2 | + 

7, p \S2S1) <5 2 5i |+5,(5 |S 2 S 2 ) <S 2 S 2 | . (43) 

The payoffs are then obtained as mean values of these operators i.e. Pa,b — 
Tr[(PA,B)operPfin]- Because the quantum game is symmetric with the initial 
state dm and the payoff matrix (|4*D|) , there is no need for subscripts. We can , 
then, write the payoff to a p-player against a g-player as P(p, q), where the first 
number is the focal player's move. When p is a NE we find the following payoff 
difference: 



P(p,p)-P(p,*p) = (p-p){\a\ 2 (P~6) + 
\b\ 2 ( 1 -a)-p{{ft~5) + ( 1 - a )}]. (44) 

Now the ESS conditions for the pure strategy p = are given as 



1. \b\ 2 {{ft-5)-{ 1 -a)}> (/3 -S) 

2. If \ b \ 2 {(ft-8)-( 1 -a)} = (ft-S) 

then q 2 {{[3-5) + (7- a)} > (45) 

where 1 is the NE condition. Similarly the ESS conditions for the pure strategy 
p = 1 are 



1. |6| 2 {(7 -a) -(/?-£)}> (7 -«) 

2. If \b\ 2 {( 7 - a) - (p - 5)} = (7 - a) 

then (I - q) 2 {{ft - 5) + (j - a)} > 0. (46) 

Because these conditions, for both the pure strategies p = 1 and p = 0, depend 
on \b\ 2 , therefore, there can be examples of two-player symmetric games for 
which the evolutionary stability of pure strategies can be changed while playing 
the game using initial state in the form \tpi n } = a \S1S1) + b \S2S2}. However, 



for the mixed NE, given as p — (i3-S)+(-y-a) < ^ ne corres P on ding payoff 



_ \a\ A {l3-8) + \b\ il-a) 
(>-5)+( 7 -a) 

difference (j4"4")l becomes identically zero. From the second condition of an ESS 
we find for the mixed NE p the difference 



P(p,q)-P(q,q) = 



[ft - 8) + (7 - a) 



[(P-6)-q{(P-6) + ( 1 - a)} - \b\ 2 {{ft - 5) - (7 - a)} } 2 . (47) 
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Therefore, the mixed strategy p is an ESS when {(/3 — S) + (7 — a)} > 0. This 
condition, making the mixed NE p an ESS, is independent of \b\ 2 . So that, in 
this symmetric two-player quantum game, evolutionary stability of the mixed 
NE p can not be changed when the game is played using initial quantum states 
of the form (jUj) . 

However, evolutionary stability of pure strategies can be affected, with this 
form of the initial states, for two-player symmetric games. Examples of the 
games with this property are easy to find. The class of games for which 7 = a 
and (J3 — 5) < the strategies p = and p = 1 remain NE for all |6| 2 G [0, 1]; 
but the strategy p = 1 is not an ESS when |6| 2 = and the strategy p = is 
not an ESS when \b\ =1. 

Consider the symmetric bi-matrix game f)40[) with the constants a, /3, 7, 6 
satisfying the conditions: 

0,0,1,8 >0; (8-0) > 0; (7 - a) > 0; (7 - a) < (6-/3). (48) 

The condition making (p*,p*) a NE is given by (|44|) . For this game three Nash 
equilibria arise i.e. two pure strategies p* = 0, p* = 1, and one mixed strategy 
p* = t* 5 -/ 3 )!"! ~(T~ Q! )l fc l These three cases are considered below. 

r ((5-/3)-(7-q) 

Case p* = : For the strategy = to be a NE one requires 



P(0,0)-P(p,0) 



( 7 _ a ) + (5 - 0) 



(7- a) 



(7 -a) + (5-/3) 



> (49) 



(7-") 



and the difference {P(0, 0) - P(p, 0)} > when 1 > |a| > (7—77-7™ 
this range of |a| 2 the equilibrium p* = is a pure ESS. However, when |a| 2 



In 



(7-g) 



we have the difference {P(0, 0) — P(p, 0)} identically zero. The 



( 7 -a) + (<5-/3) 

strategy p* = can be an ESS if 



P(0,p)-P(p,p) 

u \<a flu/i i 2 (l-p)(7-a)+p(^-/3) l „ n / Kn x 
= f{(7-«) + (5-W|H (7 _ a) + ^_^ )>0 (50) 

that can be written as 

P(0,p)-P( P ,p)^p{( 1 -a) + (S-p)}{\a\ 2 -r} >0 (51) 

6 An alternative possibility is to adjust \b\ 2 = — — ^^^j^ ^^^y which makes the differ- 
ence |p(p, q) — P(q, g) J identically zero. The mixed strategy p then does not remain an ESS. 

However such 'mutant dependent' adjustment of |6| 2 is not reasonable because the mutant 
strategy q can be anything in the range [0, 1] . 
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where -, — (7 ~°j m < F < -, — ( - 

(7-q) + (5-/3) — — (7-a 



(7-a) + (<5-/3) 



can be an ESS only when \a\ > 



when < p < 1. The strategy p* = 
which is not possible because 



\a\ 2 is fixed at 

,,2 > (7-c^ 



( 7 -a)+(<5-/3) ■ 



( 7 -«) + (5-/5) 

Therefore the strategy p* — is an ESS for 1 > 



( 7 -a) + (5-/3) 



and for lal' 



(7-") 



this NE becomes unstable. The 



(~f-a) + (8-f3) 

classical game is obtained by taking \a\ 2 = 1 for which p* = is an ESS or 
a stable NE. However this NE does not remain stable for lal 2 = -, — m 
which corresponds to an entangled initial state; though the NE remains intact 
in both forms of the game. 



Case p* = 1 : Similar to the last case the NE condition for the strategy p* = 1 
can be written as 



P(1,D 



P{p, 1) 



(1-P) 



( 7 - a) + (6- (3) 



(8-0) 



( 7 - a) + (6 - p) 



> 0. (52) 



For | a 



2 _ (S-0) 



Now = 1 is a pure ESS for < \a\ < ^_ a)+(s _ 0) . — |M| - (7 _ a)+(i _^ 
the difference {P(l, 1) — P(p, 1)} becomes identically zero. The strategy p* = 1 
is an ESS when 



P(l,p)-P(p,p) 

= (1 - p) {(7 - a) + (5 - P)} {- |a| 2 + ^^±^^ \ U. 



( 7 - a) + (5 - /?) 



(53) 



It is possible only if ja] < 



stable NE (ESS) for < \a\ < 



(7-a) + (<5-/3) 



( 7 -Q) + (<5-/3) 



Therefore the strategy p* = 1 is a 
It is not stable classically (i.e. for 



1) but becomes stable for an entangled initial state. 



Case p* 



(<5-/3)|q| 2 -(7-a)|fc| 2 



(S-/3)-(7-a) 



In case of the mixed strategy: 



p * = (8-13) \a\ 2 - ( 7 -a) \b\ 2 



(8-(3)-( 7 -a) (M) 

the NE condition (|44|) turns into P(p*,p*) — P(p,p*) = 0. The mixed strategy 
l(53|) can be an ESS if 



P{p\p) - P(p,p) 

= (p* - p) [- \a\ 2 (5-/3) + \b\ 2 (7 - a) + p {(5 - (3) - (7 - a)} 



> 



(55) 
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for all p 7^ p* . Write now the strategy p as p — p* + A. For the mixed strategy 
(|54|) the payoff difference of the Eq. (|55|) is reduced to 

P(p\p) - P{p,p) = - A 2 {(6- (3) - ( 7 - a)} . (56) 
Hence, for the game defined in the conditions (j4"8|) , the mixed strategy p* — 

^~(a-%-(7-°) ^ cannot be an ESS, though it can be a NE of the symmetric 
game. 

It is to be pointed out that above considerations apply when the game is 
played with the initial state (j4"Tj) . 

To find examples of symmetric quantum games, where evolutionary stability 
of the mixed strategies may also be affected by controlling the initial states, the 
number of players are now increased from two to three. 



4.2.3 2x2x2 symmetric games 

In extending the two-player scheme to a three-player case, we assume that three 
players A, B, and C play their strategies by applying the identity operator I 
with the probabilities p, q and r respectively on the initial state \ipi n ) . Therefore, 
they apply the operator a x with the probabilities (1 — f>), (1 — q) and (1 — r) 
respectively. The final state becomes 



Pfin = Pr (^) Pr (M Pr(L>c) Ua ®Ub® UcpinU A ®U%® Ul\ (57) 

where the 8 basis vectors are \SiSjSk), for k = 1,2. Again we use initial 
quantum state in the form \ipi n ) — a ISiSiSi) +b \S2S2S2), where \a\ +\b\ = 1. 
It is a quantum state in 2(g) 2(g) 2 dimensional Hilbert space that can be prepared 
from a system of three two-state quantum systems or qubits. Similar to the two- 
player case, the payoff operators for the players A, B, and C can be defined as 



(PA,B,c)oper = 

oil, Puffr I Si Si Si) (S1S1S1I + a 2 ,/3 2 ,?72 |S 2 SiSi) (S2S1S1I + 

«3,/?3, m IS1S2S1) (SiS 2 Si| + ck4,/34, m \S\SiS 2 ) (S1S1S2I + 

"5)^5, m \SiS 2 S 2 ) (SiS 2 S 2 | + a 6 ,(3 e , rje \S 2 S 1 S 2 ) (S 2 SiS 2 \ + 
a 7 ,(3 7 ,r] 7 \S 2 S 2 Si) (S2S2S1I +a s ,(3s,r] 8 \S 2 S 2 S 2 ) (S 2 S 2 S 2 \ (58) 

where cti,/3i, rji for 1 < I < 8 are 24 constants of the matrix of this three-player 
game. Payoffs to the players A, B, and C are then obtained as mean values of 
these operators i.e. Pa,b,c(p, <l, r ) —^[(Pa ,B ,c) oper Pfin] ■ 

Here, similar to the two-player case, the classical payoffs can be obtained 
when \b\ 2 = 0. To get a symmetric game we define Pa{x, y, z) as the payoff to 
player A when players A, B, and C play the strategies x, y, and z respectively. 
With following relations the players' payoffs become identity-independent. 
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Pa{x, y, z) = P A (x, z, y) = P B (y, x, z) 
= P B (z,x,y) = P c (y,z,x) = P c (z,y,x). (59) 

The players in the game then become anonymous and their payoffs depend only 
on their strategies. The relations (f59"| hold with the following replacements for 
fa and 





-» Oil 


f3 2 - 


■+ a 3 


/3 3 - 


-> «2 




-> a 3 


05- 


-* a 6 


Pe- 


-> «5 


Pr- 


"* ^6 




-> a 8 


m - 


-» ai 


m - 


■+ «3 


m - 




m - 


■+ «2 


V5 - 


-> a 6 


ve - 


-> a 6 


V7 - 


a 5 


vs - 


* «8- 



(60) 



Also, it is now necessary that we should have ae = aj, a 3 = a^. 

A symmetric game between three players, therefore, can be defined by 
only six constants of the payoff matrix . These constants can be taken as 
a%, «2t «3> 0(5, «6) and as- Payoff to a p-player, when other two players play q 
and r, can now be written as P(p, q,r). A symmetric NE p is now found from 
the Nash condition P(p,p,p) — P(p,p,p) > i.e. 



P$,p,p) - P(P,P,P) = {p-p)[p{l-2\b\ 2 )(<T + cj-2 V ) + 
2 P {|5| 2 {a + uo - 2rj) - u> + r)\ + {oj - \b\ 2 (a + w)\] >0 (61) 

where (a± — a 2 ) — <J, (0:3 — as) — ?7,and (05 — as) = w. 
Three possible NE are found as 



Pl = 1 ! 



|6| 2 ) + (?7 2 -o-w) 



(l-2|f<n(er+w-2rf) 

P3 = 1 



(62) 



It is observed that the mixed NE p\ makes the difference |p(|>, p, p) — P(p, P, p) | 

identically zero and two values for p 1 can be found for a given |6| 2 . Apart from 
Pi the other two NE (i.e. p 2 and p 3 ) are pure strategies. Also now p 1 comes 
out a NE without imposing further restrictions on the matrix of the symmetric 
three-player game. However, the pure strategies p 2 and p 3 can be NE when 
further restriction are imposed on the matrix of the game. For example, p 3 can 
be a NE provided a > {us + a) \b\ 2 for all \b\ 2 e [0, 1]. Similarly p 2 can be NE 
when lo < (u> + a) \b\ 2 . 
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Now we address the question: How evolutionary stability of these three NE 
can be affected while playing the game via initial quantum states given in the 
following form? 

|^)=a|SiSiSi)+&|S 2 S 2 S 2 ). (63) 

For the two-player asymmetric game of BoS we showed that out of three NE 
only two can be evolutionary stable. In classical evolutionary game theory the 
concept of an ESS is well-known [33J IM| to be extendable to multi-player case. 
When mutants are allowed to play only one strategy the definition of an ESS 
for the three-player case is written as [33] 

1. P(p,p,p) > P(q,p,p) 

2. UP(p,p,p) = P(q,p,p) then P(p,q,p) > P(q,q,p). (64) 

Here p is a NE if it satisfies the condition 1 against all q ^ p. For our case the 
ESS conditions for the pure strategies p 2 and p 3 can be written as follows. For 
example p 2 — is an ESS when 

1. a\b\ 2 > uj\a\ 2 

2. If a \b\ 2 = uj \a\ 2 then - W 2 (|a| 2 - \b\ 2 ) > 

where 1 is NE condition for the strategy p 2 = 0. Similarly, p 3 
when 

1. cr \a\ 2 > uj \b\ 2 

2. If cr \a\ 2 = uj \b\ 2 then ?/(l - qf{\a\ 2 - \b\ 2 ) > (66) 

and both the pure strategies p 2 andp 3 are ESSs when \a\ 2 = \b\ 2 . The conditions 
l|66p can also be written as 

1. a > (uj + cr) \b\ 2 

2. If a = \b\ 2 (w + a) then 1 ^ - ^ > 0. (67) 
For the strategy p 2 — the ESS conditions l|65p reduce to 

1. uj < (uj + a) \b\ 2 

2. If uj = \b\ 2 (uj + cr) then 7 fr - a ) > (68) 

(UJ + cr) 



(65) 

= 1 is an ESS 
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Examples of three-player symmetric games are easy to find for which a pure 



strategy is a NE for the whole range \b\ 2 £ [0, 1], but it is not an ESS for some 



particular value of \b\ 2 . An example of a class of such games is for which (7 = 0, 



< 0, and rj < 0. In this class the strategy p 2 — is a NE for all |6| 2 £ [0, 1] 



but not an ESS when |6| = 1. 

Apart from the pure strategies, the mixed strategy equilibrium p 1 forms the 
most interesting case. It makes the payoff difference ^P(p\,p\,p\) — P(p,pi,pi)| 

identically zero for every strategy p. The strategy p\ is an ESS when |p(pi, q,pi) — P{q, <?,pi)| > 



but 



= ±(pi - q) 2 \/{(^ + iof - (2r?)2} \b\ 2 (1 - |6| 2 ) + - auj). (69) 

Therefore, out of the two possible roots (pi)i and (p\)2 of the quadratic equa- 
tiorQ 



pi \l - 2\b\ 2 )(a + uj - 2r])+ 
2pi {|6| 2 (<t + uj - 2r)) - lu + r)\ + {uj - \b\ 2 (a + co)} = (70) 



only (pi)i can exist as an ESS. When the square root term in the equation (169|) 
becomes zero we have only one mixed NE, which is not an ESS. Hence, out of 
four possible NE in this three-player game only three can be ESSs. 

An interesting class of three-player games is the one for which ry 2 = aui. For 
these games the mixed NE are 

I( w - r] )-\b\ 2 (a + cj-2T ] )}±\a\\b\\a-uj\ 

Pi = ~ 2 " ( 71 ) 

(l-2|6| 2 )(a + ^- 277) 

and, when played classically, we can get only one mixed NE that is not an ESS. 
However for all \b\ 2 , different from zero, we generally obtain two NE out of which 
one can be an ESS. 

Similar to the two-player case, the equilibria in a three-player symmetric 
game where quantization affects evolutionary stability, are the ones that survive 
for two initial states, one of which is a product state and corresponds to the 
classical game. Suppose p*\ remains a NE for |6| 2 = and some other non-zero 
|6| 2 . It is possible when (a — u)(2pi — 1) = 0. Alternatively, the strategy p—\ 
remains a NE for all |6| 2 G [0, 1]. It reduces the defining quadratic equation (|70[) 



7 These roots make the difference |p(pi , g, Pi) — P(q, q, Pi )| greater than and less than 
zero, respectively. 
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for p*i to a + uj + 2i] = and makes the difference |P(pi, q,p*i) — P(q, q,p*i)j 

independent of \b\ 2 . Therefore the strategy p = h, even when it is retained as 
an equilibrium for all \b\ 2 € [0, 1], cannot be an ESS in only one version of the 
symmetric three-player game. For the second possibility a = lj the defining 
equation for p*i is reduced to 



(1-2|&| 2 ) jpi - 
for which 



(77 - a) - \]r\ 2 - a 2 
2(7? - a) 




(77 - a) + yjrf — a 2 
2(7? -a) 



= (72) 



P(pi,q,Pl) - P(q,q,Pl) = ±2{ P1 - q) 2 



vV - a 2 . 



(73) 



Here the difference |p(pi, q,P\) — P(q, q,Pi)\ still depends on |6| 2 and becomes 
zero for \b\ 2 — 1/2. 

Hence, for the class of games for which a = u> and 77 > a, one of the mixed 
strategies (^1)1,(^1)2 remains a NE for all \b\ 2 G [0,1] but not an ESS when 
|6| 2 = 1/2. In this class of three-player quantum games the evolutionary stability 
of a mixed strategy can, therefore, be changed while the game is played using 
initial quantum states in the form (|63p . 



4.2.4 Rock-Scissors-Paper game 

Rock-Scissors-Paper (RSP) is a game for two players that is typically played 
using the players' hands. This game has been played for long as a children's 
pastime or as an odd-man-out selection process. The players opposite each 
others, tap their fist in their open palm three times (saying Rock, Scissors, 
Paper) and then show one of three possible gestures. The Rock wins against 
the scissors (crushes it) but looses against the paper (is wrapped into it). The 
Scissors wins against the paper (cuts it) but looses against the rock (is crushed 
by it). The Paper wins against the rock (wraps it) but looses against the scissors 
(is cut by it). The game is also played in nature like many other games. Lizards 
in the Coast Range of California play this game [35] using three alternative male 
strategics locked in an ecological never ending process from which there seems 
little escape. 

In a slightly modified version of the RSP game both players get a small 
premium e for a draw. This game can be represented by the payoff matrix : 

RSP 













1 



where —1 < e < 0. The matrix of the usual game is obtained when e is zero. 



2G 



One cannot win if one's opponent knew which strategy was going to be 
picked. For example, picking Rock consistently all the opponent needs to do 
is pick Paper and s/he would win. Players find soon that in case predicting 
opponent's strategy is not possible the best strategy is to pick Rock, Scissors, 
or Paper at random. In other words, the player selects Rock, Scissors, or Paper 
with a probability of 1/3. In case opponent's strategy is predictable picking a 
strategy at random with a probability of 1/3 is not the best thing to do unless 
the opponent does the same [2D]- 

Analysis [5] of the modified RSP game of matrix (|7^|) shows that its NE con- 
sists of playing each of the three different pure strategies with a fixed equilibrial 
probability 1/3. However it is not an ESS because e is negative. 

Here we want to study the effects of quantization on evolutionary stability for 
the modified RSP game. The game is different, from others considered earlier, 
because classically each player now possesses three pure strategies instead of 
two. A classical mixed NE exists which is not an ESS. Our motivation is to 
explore the possibility that the classical mixed NE becomes an ESS for some 
quantum form of the game. 

Quantization of Rock-Scissors- Paper game: Using simpler notation: R ~ 
1, 5 ~ 2, P ~ 3 we quantize this game via MW scheme |24| . We assume the 
two players are in possession of three unitary and Hcrmitian operators /, C and 
D defined as follows. 



J 11} 


= |1). 


C\l) 


= |3>, 


b\i) 


= |2) 


J|2) 


= |2>, 


C\2) 


= |2), 


D\2) 


= 11} 


J|3) 


= |3), 


(7|3) 


= |1>, 


D|3) 


= |3) 



where C'=C = C^ 1 and D' = D = D^ 1 and / is the identity operator. 

Consider a general two-player payoff matrix when each player has three 
strategies: 

1 2 3 

1 / (aii,/?ii) (a 12 ,f3 12 ) (a 13 ,(3 13 ) \ 

2 (a 2 l,/?2l) («22,/?22) (a23,/323) (76) 

3 \ (a31,/?3l) («32,/?32) («33,/333) / 

where a,j and /%j are the payoffs to Alice and Bob, respectively, when Alice 
plays i and Bob plays j and 1 < i,j < 3. Suppose Alice and Bob apply the 
operators C, D, and / with the probabilities p, p±, (1 — p — p\) and q, qi, 
(1 — q — qi) respectively. The initial state of the game is p%n- Alice's move 
changes the state changes to 

Pin = (1 -p-Pl)lAPini\ +pCAPinC\ +Pib A p in b\. (77) 

The final state, after Bob too has played his move, is 
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Pf = (1 - 5 - ?l)-fBpfn^B + qC B pi n C\ + q X t> BPin^. (78) 

This state can be written as 

p'/ 3 = (l -p-pi)(i - g - gi) | /a ® iBPinlA ® i B } +p(1 - q- qi)x 

|Ca ® lBPi n C\ ® 4} + Pi(l - q- qi) [Da ® lBpi n D A ® 4} + 

(1 - P - Pl)8 {^4 ® &Bpi n Q ® ^L} + P9 ® C B p in C\ <8> C*1j} + 

pig {.Da ® C B pinD A ® C*jj| + (1 - p - pi)gi {/a ® b B p in P A ® D B \ 

+ P qi {c A ®b BPin c\®b B } + Piqi {b A ® b BPin b A ® b B } . (79) 

The nine basis vectors of initial quantum state with three pure classical strate- 
gies are for i, j = 1, 2, 3. We consider the initial state to be a pure quantum 
state of two qutrits i.e. 

\ipin) = J! c y'l^')' where |cy| 2 = 1. (80) 

4,3=1,2,3 i,j=l,2,3 

The payoff operators for Alice and Bob are [2"1] 

(PA,fl)oper - (a,/3)n |H) (H| + («,/3)i2 |12) <12j + (a,/3)i3 |13) (13| + 
(a,j8) 2 i |21) (21| + (a,/3) 22 |22) (22| + (a,/?) 23 |23) <23j + 
(a,/3) 3 i |31) (31| + (a,/3) 32 |32) <32j + (a,/3) 33 [33) (33| . 

(81) 

The players' payoffs are then 

P A , B = Ty[{(P a } Pf } (82) 

Payoff to Alice, for example, can be written as 

P A = $f2T T (83) 
where T is for transpose, and the matrices <&, f2, and T are 
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$ = [ (1 -p-pi)(l - q- q x ) p{l-q-q x ) Px{l-q-qi) 

{l-p-Px)q pq piq (l-p-pi)qi pqi pm } 

T = [ an ai2 a i3 a 2 i a 22 a 2 3 "31 «32 033 ] 
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Cn 




C13 
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(84) 

The payoff (183)) corresponds to the matrix (|76| . Payoffs in classical mixed 
strategy game can be obtained from Eq. (f8"2"|) for the initial state jV'm) = |H)- 
The game is symmetric when onj — [3ji in the matrix (|76p . The quantum 
game played using the quantum state (|80[) is symmetric when \cij\ 2 = \cji\ 2 for 
all constants Cy in the state (|80|) . These two conditions together guarantee a 
symmetric quantum game. The players' payoffs Pa, Pb then do not need a 
subscript and we can simply use q) to denote the payoff to the p-player 
against the g-player. 

The question of evolutionary stability in quantized RSP game is addressed 
below. 

Analysis of evolutionary stability: Assume a strategy is defined by a pair 
of numbers (p,pi) for players playing the quantized RSP game. These numbers 
are the probabilities with which the player applies the operators C and D. The 
identity operator / is, then, applied with probability (1 — p — Px)- Similar to 
the conditions a) and b) in Eq. the conditions making a strategy (p*,p\) 
an ESS can be written as [T71 [5] 

1. P{(p*,pt), (p*,p*x)} > P{( P ,pi), (p*,p*x)} 

2. if P{(p*,p*x), (p*,p*x)} - P{( P ,Pi), (p*,P*x)} then 

P{(p*,p*x), (p,px)} > P{(p,Pi), (p,Pi)}- (85) 

Suppose (p*,Px) is a mixed NE then 

f dP dP ] 

— | p=? ^ (p*- p ) + _ I * (p* 1 -px)\>0. (86) 
{ dP Pl = qi=P { opx Pl = qi=P i J 

Using substitutions 
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we get 



|cn| 2 - | C3 1 1 2 = Ai, |c 2 i| 2 - |cn| 2 = A-l 

|ci3| 2 -|c 33 | 2 = A 2 , |c 22 | 2 -|c 12 | 2 = A 2 (87) 

|ci 2 | 2 - |c 32 | 2 = A 3 , |c 23 | 2 - |ci 3 | 2 = A 3 



dP 

-t— I P =q= P * = P (Ai - A 2 ) {(an + a 33 ) - (a i3 + a 31 )} + 
P pi=h=pI 
p*(Ai - A 3 ) {(an + a 32 ) - (a i2 + a 31 )} - 

Ai (an - a 3 i) - A 2 (a i3 - a 33 ) - A 3 (a i2 - a 32 ), (88) 



dP 
dpi 



p =q=p * = P*(A 3 - A x ) {(an + a 23 ) - (a i3 + a 2 i)} + 



Pl=9l=Pi 

pl(A 2 - A x ) {(an + a 22 ) - (a i2 + a 2i )} + 

A-l (an - a 2i ) + A 2 (a i2 - a 22 ) + A 3 (ai 3 - a 23 ). (89) 
For the matrix (|74|) the equations (|88l l89|) can be written as 



OP 
dp 



P=q=P > = Ai {-2ep* - (3 + eK + (1 + e)} - 



Pl=9l=Pi 

A 2 {2ep* + (1 - e)} + A 3 {(3 + e)p* - 2} (90) 

dP 
dpi 



=q=p > = A x {-?/(3 - e) + 2epJ + (1 - e)} 



pi=qi=p 1 

A 2 {2erf - (1 + e)} + A 3 {(3 - e)p* - 2} . (91) 

The payoff difference in the second condition of an ESS given in the Eq. (|85|) 
reduces to 



p {{P*,Pi), (P,Pl)} ~ P{(p,Pi), (p,Pi)} 
= (p* —p)[— Ai {2ep + (3 + e) Pl - (1 + e)}+ 
A 2 {2ep + (1 - e)} + A 3 {(3 + e) Pl - 2}] + 
(pi - Pl )[- A; {(3 - e)p - 2e Pl - (1 - e)}- 
A 2 {2e Pl - (1 + e)} + A 3 {(3 - e)p - 2}]. (92) 

With the substitutions (p* — p) = x and (p* — p 1 ) = y the above payoff difference 
is 



P{(p*,Pi), (p,Pi)} ~ P{(p,Pi), (p,Pi)} 
= Aix {2ex + (3 + e)y} - A 2 (2ex 2 ) - A 3 a;jy(3 + e)- 
A; y {2ey - (3 - e)x} + A 2 (2ey 2 ) - A 3 xy(3 - e) (93) 
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provided that 

dP dP 

~K~ I p=q=p* — jr— | p=q=p* — 0. (94) 

The conditions in Eq. (|M|) together define the mixed NE (f>*,f>i). Consider now 
the modified RSP game in classical form obtained by setting |cn| 2 = 1. The 
Eqs. ([94]) become 



-2qj*-(e + 3)p£ + (e+l)=0 

(-e + 3)p* - 2ep| + (e - 1) = (95) 

and p* — Pi = -| is obtained as a mixed NE for all the range — 1 < e < 0. From 
Eq. (US} we get 

P{(p*,pf), (p,pi)} - P{(p,pi), (p,pi)} 

= 2e(x 2 + y 2 + xy) = e {{x + yf + (x 2 + y 2 )} < 0. (96) 

In the classical RSP game, therefore, the mixed NE p* = p\ = | is a NE but 
not an ESS, because the second condition of an ESS given in the Eq. (|85[) does 
not hold. 

Now define a new initial state as 

|^„) = i{|12) + |21) + |13) + |31)} (97) 

and use it to play the game, instead of the classical game obtained from \ipi n ) = 
1 11). The strategy p* — p\ — | still forms a mixed NE because the conditions 
(|94|) hold true for it. However the payoff difference of Eq. (|93|) is now given 
below, when — 1 < e < and x, y ^ 0: 



p {(P*,Pi)> (p,Pi)} - P{(p,Pi), (p,Pi)} 
= -e{(x + y) 2 + (x 2 + y 2 )}>0. (98) 

Therefore, the mixed NE p* = p* = |, not existing as an ESS in the classical 
form of the RSP game, becomes an ESS when the game is quantized and played 
using an initial (entangled) quantum state given by the Eq. (|97|) . 

Note that from Eq. (|82|) the sum of the payoffs to Alice and Bob (Pa + Pb) 
can be obtained for both the classical mixed strategy game (i.e. when \ipi n ) — 
1 11)) and the quantum game played using the quantum state of Eq. (|9T)l . For 
the matrix (f74|) we write these sums as (Pa + Pb)cI and (PA + PB) qu for classical 
mixed strategy and quantum games, respectively. We obtain 

(P A + Pb)cI = -2e {(1 - p - Pl )(l - q - qi ) + p x q x + pq} (99) 
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and 



(Pa + PbU =-^-(PA+P B )cl+ej. (100) 

In case e = both the classical and quantum games are clearly zero sum. For 
the slightly modified version of the RSP game we have — 1 < e < and both 
versions of the game become non zero-sum. 



5 Concluding Remarks 

Evolutionary stability is a game-theoretic solution concept that tells which 
strategies are going to establish themselves in a population of players engaged in 
symmetric contests. By establishing itself it means that the strategy becomes 
resistent to invasion by mutant strategies when played by a small number of 
players. Analysis of evolutionary stability in quantum games shows that quan- 
tization of games, played by a population of players, can lead to new stable states 
of the population in which, for example, a quantum strategy establishes itself. 
Our results show that quantum strategies can indeed change the dynamics of 
evolution as described by the concept of evolutionary stability. Quantum strate- 
gies being able to decide evolutionary outcomes clearly gives a new role to quan- 
tum mechanics which is higher than just keeping the atoms together. Secondly, 
evolutionary stability in quantum games provides a mathematically tractable 
method of analysis for studying multi-player quantum games [36j played in evo- 
lutionary arrangements. 

Using EWL and MW quantization schemes , we explored how quantization 
can change evolutionary stability of Nash equilibria in certain asymmetric bi- 
matrix games. The ESS concept was originally defined for symmetric bi-matrix 
contests. We showed that quantization can change evolutionary stability of 
a NE also in certain types of symmetric bi-matrix games. We identified the 
classes of games, both symmetric and asymmetric, for which within the EWL 
and MW schemes the quantization of games becomes related to evolutionary 
stability of NE. For example, in the case of Prisoners' Dilemma we found that 
when a population is engaged in playing this symmetric bi-matrix game, a small 
number of mutant players can invade the classical ESS^ when they exploit Eisert 
and Wilken's two-parameter set of quantum strategies. As another example 
we studied the well-known childrens' two-player three-strategy game of Rock- 
Scissors-Paper. In its classical form a mixed NE exists that is not evolutionarily 
stable. We found that in a quantum form of this game, played using MW 
quantization scheme , the classical NE becomes evolutionarily stable when the 
players share an entangled state. 

We speculate that evolutionary stability in quantum games can potentially 
provide a new approach towards the understanding of rise of complexity and 
self-organization in groups of quantum-interacting entities, although this opin- 
ion, at the present stage of development in evolutionary quantum game theory 

8 consisting of Defection-Defection strategy pair 
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, remains without any supportive evidence, either empirical or experimental. 
However, it seems that the work presented in this chapter provides a theoret- 
ical support in favor of this opinion. Secondly, evolutionary quantum game 
theory benefits from the methods and concepts of quantum mechanics and evo- 
lutionary game theory, the second of which is well known to facilitate better 
understanding of complex interactions taking place in communities of animals 
as well as that of the bacteria and viruses. Combining together the techniques 
and approaches of these two, seemingly separate, disciplines appears to provide 
an ideal arrangement to understand the rise of complexity and self-organization 
at molecular level. 

Although it is true that evolutionary stability and evolutionary computation 
provide two different perspectives on the dynamics of evolution, it appears to 
us that an evolutionary quantum game-theoretic approach can potentially pro- 
vide an alternative viewpoint in finding evolutionary quantum search algorithms 
that may combine the advantages of quantum and evolutionary computing [37] . 
This will then also provide the opportunity to combine the two different philoso- 
phies representing these approaches towards computing: evolutionary search 
and quantum computing. 
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